A Novel Assessment Tool for Quantitative Evaluation of Science Literature Search Performance: Application to First-Year and Senior Undergraduate Biology Majors

Jason M. Blank is Associate Professor and Elena L. Keeling is a Professor in the Department of Biological Sciences; Karen J. McGaughey is Assistant Professor and Conor C. Shannon is Undergraduate Research Assistant in the Department of Statistics; and Jeanine M. Scaramozzino is Associate Librarian in Robert E. Kennedy Library; all at California Polytechnic State University; e-mails: [email protected], ekeeling@ calpoly.edu, [email protected], [email protected], [email protected]. Kristen L. Thorp is Youth Services Manager at Eugene Public Library; e-mail: [email protected]. © 2016 Jason M. Blank, Karen J. McGaughey, Elena L. Keeling, Kristen L. Thorp, Conor C. Shannon, and Jeanine M. Scaramozzino, Attribution-NonCommercial (http://creativecommons.org/licenses/by-nc/3.0/) CC BY-NC. Expertise in searching and evaluating scientific literature is a requisite skill of trained scientists and science students, yet information literacy instruction varies greatly among institutions and programs. To ensure that science students acquire information literacy skills, robust methods of assessment are needed. Here, we describe a novel tool for longitudinal, crossover assessment of literature-searching skills in science students and apply it to a cross-sectional assessment of literature-searching performance in 145 first-year and 43 senior biology majors. Subjects were given an open-ended prompt requiring them to find multiple sources of information addressing a particular scientific topic. A blinded scorer used a rubric to score the resources identified by the subjects and generate numerical scores for source quality, source relevance, and citation quality. Two versions of the assessment prompt were given to facilitate eventual longitudinal study of individual students in a crossover design. Seniors were significantly more likely to find relevant, peer-reviewed journal articles, provide appropriate citations, and provide correct answers to other questions about scientific literature. This assessment tool accommodates large numbers of students and can be modified easily for use in other disciplines or at other levels of education.